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Abstract 

In this paper, we will discuss the concept of an array variate random 
variable and introduce a class of skew normal array densities that are 
obtained through a selection model that uses the array variate normal 
density as the kernel and the cumulative distribution of the univariate 
normal distribution as the selection function. 

1 Introduction 

The array variate random variable up to 2 dimensions has been studied inten- 
sively in Gupta and Nagar(2000)| and by many others. For arrays observations 



of 3, 4 or in general i dimensions a suitable normal probability model has been 
recently proposed in Akdemir and Gupta (20 11)] ■ An elliptical generalization 



of the normal array variable can be found in [Akdemir(2011)]. In this paper, 
we will generalize the notion of elliptical random variables to the array case. 

In Section 2, we first study the algebra of arrays, and introduce the concept 
of an array variable random variable. In Sections 3, the density of the normal 
array random variable is provided. We finally provide the definition for an array 
random variable with skew normal density in Section 4. 



2 Array Algebra 

In this paper we will only study arrays with real elements. We will write X to 
say that X is an array. When it is necessary we can write the dimensions of 
the array as subindices, e.g., if A" is a nii x m2 x x dimensional array 
in ^™ix™2x...xmi^ then we can write Xmixmixmsxnu- Arrays with the usual 
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element wise summation and scalar multiplication operations can be shown to 
be a vector space. _ 

To refer to an element of an array Xmixm2xm3xm4, we write the position of 
the element as a subindex to the array name in parenthesis, {X)r-^r2r3ri - If we 
want to refer to a specific column vector obtained by keeping all but an indicated 
dimension constant, we indicate the constant dimensions as before but we will 
put ':' for the non constant dimension, e.g., for ^mixmsxmaxmi, (-'^)rir2:r4 

refers to the the column vector {{X)rir2lr4, {X)rir22r4, • • • , iX)rir2m3r4Y ■ 

We will now review some basic principles and techniques of array alge- 
bra. These results and their proofs can be found in Rauhala [Rauhala ( 1 9 74 )| , 
|Rauhala(1980)] and Blaha |Blaha(1977)] . 

Definition 2.1. Inverse Kronecker product of two matrices A and B of dimen- 
sions p X q and r X s correspondingly is written as A B and is defined as 
A (g)' _B = [A{B)jk]prxqs = -B O A, where '(8)' represents the ordinary Kronecker 
product. 

The following properties of the inverse Kronecker product are useful: 

• 0& A^ A(E)''0 = 0. 

• {Ai + A2) & B ^Ai& B + A2 & B. 

• A& {Bi +B2) = A&Bi+A & B2. 

• aA & /3B = a/3A & B. 

• {Ai & Bi){A2 & B2) = A1A2 & B1B2. 

• {A& B)-^ = [A-^ & B-^). 

• [A & 5)+ = & B^), where is the Moore-Penrose inverse of A. 

• {A & B)^ = {A^ & -B )j where A^ is the ^-inverse of A defined as 
A- = {A'A)-^A'. 

• If {A;} and {fJ^j} are the eigenvalues with the corresponding eigenvectors 
{a;^} and {Uj} for matrices A and B respectively, then A(E)'^ B has eigen- 
values {Ai/ij} with corresponding eigenvectors {xi Cg)' Uj}- 

• Given two matrices A„xn and B„ixm \A& B\ ^ \A\"^\B\", tr{A& B) = 
tr[A)tr{B). 

• A & B — B ® A — UiA(E} BU2, for some permutation matrices Ui and 1/2- 
It is well known that a matrix equation 

AXB' = C 
can be rewritten in its monolinear form as 

A& BveciX) = vec{C). (1) 
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Furthermore, the matrix equahty 

A & BXC = E 

obtained by stacking equations of the form ([T]) can be written in its monoHnear 
form as 

{A & B & C)vec{X) = vec{E). 

This process of stacking equations could be continued and R-matrix multiplica- 
tion operation introduced by Rauhala [Rauhala(1974)| provides a compact way 
of representing these equations in array form: 

Definition 2.2. R-Matrix Multiplication is defined element wise: 
{{A,)\A2f...{A,y 

mi 7712 ms mi 

= ^ (^l)giri ^(^2)921-2 {^3)q3r3 ■ ■ ■ (^Og.n (^)rir2 . . .n ■ 

ri — 1 r2 — l r-s — l ri—1 

R-Matrix multiplication generalizes the matrix multiplication (array mul- 
tiplication in two dimensions)to the case of fc-dimensional arrays. The fol- 
lowing useful properties of the R-Matrix multiplication are reviewed by Blaha 
|Blaha(1977)] : 

1. {AYB^AB. 

2. {Ai)\A2fC^AiCA'^. 

3. Y = {I)Hl)\..{iyY. 

4. {{A^yiA^f . . . {A,y){{Bry{B2f . . . {B,y)Y = {ArBryiA^B^y . . . (AB^yv. 

The operator rvec describes the relationship between ^mixm2x...mi and its 
monolinear form Xmj^„i2...miXi- 

Definition 2.3. rvec{X,inixm2X...T77i) = Xmim2...miXi where x is the column 
vector obtained by stacking the elements of the array X in the order of its 
dimensions; i.e., iX)j-^j^,,,j. = {x)j where j = {ji — l)ni_ini_2 ■ • ■ n-i + {ji — 
2)ni-2ni-3 . . .ni + . . . + {j2 - l)ni + ji. 

Theorem 2.1. Let L„i-^xm2x...n7i — (^1)^(^2)^ •■• (^i)*-'^ where {Ajy is an 
rrij X Uj matrix for j — 1,2, . . . ,i and X is an ui x 712 x . . . x nt array. Write 
1 = rvec{L) and x = rvec{X). Then, I ^ Ai & A2 & . . . & AiX. 

Therefore, there is an equivalent expression of the array equation in mono- 
linear form. 

Definition 2.4. The square norm of XmiX7n2x...mi is defined as 

mi 7710 TTLi 

ii=ij2=i ji=i 



3 



Definition 2.5. The distance o/Xi„jjxm2x...mi from X2mixm2x...mi defined 



as ^||Xi-X2P. 

Example 2.1. Let Y = {Ai)\A2)'^ . . . {A^Y X + E . Then is minimized 

forX = {A^y{A^r...{AryY. 

3 Array Variate Normal Distribution 

By using the results in ttie previous section on array algebra, mainly the rela- 
tionship of the arrays to their monolinear forms described by Definition 12. 31 . we 
can write the density of the standard normal array variable. 

Definition 3.1. // 

Z ^ -/V/Tii Xm2 X ... xrrii {M = 0, A = /)nim2 . . .m; ) > 

then Z has array variate standard normal distribution. The pdf of Z is given by 

^ exp(-ill^lP) 

^ (27r)'"i'"2...ni,/2 ■ ^ 

For the scalar case, the density for the standard normal variable z € is 
given as 

For the mi dimensional standard normal vector z G R™^ , the density is given 

by ^ ^ 

(t>rm{z) = -—^exp{~-z'z). 
(27r) 2 Z 

Finally the mi x m2 standard matrix variate variable Z G R™i^™2 j^g^g i^j-^g 
density 

0mixm2(^) = ——^Y^exp{--trace{Z'Z)). 

With the above definition, we have generalized the notion of normal random 
variable to the array variate case. 

Definition 3.2. We write 

X ^ .^mi X 7712 X . . . x (-^^; -^mim2 . . .mi ) 

ifrvec{X) Nmim2...miirvec{M), Amim2...mi)- Here, M is the expected value of 
X, and Amj„i2...„i; is the covariance matrix of the mim2 . . . rm-variate random 
variable rvec{X). 
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The family of normal densities with Kronecker delta covariance structure 
are obtained by considering the densities obtained by the location-scale trans- 
formations of the standard normal variables. This kind of model is defined in 
the next. 

Definition 3.3. ( JAkdemir and Gupta(20lf)^ ) Let Z Nmixm.2x...xmiiM = 
0, A = Im,m2...m,)- Define X = (^^^(Aa)^ . . . {AiYZ + M where ^1,^2,...,^^ 
are non singular matrices of orders toi , 7712 , . . . , . Then the pdf of X is given 
by 

^{X;M,A^,A2,...A,)= ^ 1 ;v 2 ; \ ^ )\ ;ii ; 



(3) 

Distributional properties of a array normal variable with density in the form 
of Definition 13.31 variable can obtained by using the equivalent monolinear rep- 
resentation of the random variable. The moments, the marginal and conditional 
distributions, independence of variates can be studied considering the equiva- 
lent monolinear form of the array variable and the well known properties of the 
multivariate normal random variable. 



4 Array Variate Skew Normal Variable 

A very general definition of skew symmetric variable for the matrix case can be 
obtained from matrix variate selection models. Suppose X is a fc x n random 
matrix with density f{X), let g{X) be a weight function. A weighted form of 
density f{X) is given by 

_ f{X)9{X) 

- J,.^^giX)fiX)dX- 

When the sample is only a subset of the population then the associated model 
would be called a selection model. 

Chen and Gupta provide a skew normal matrix variate probability density 
function in the following form ( [Chen and Gupta(2005)| ): 

-c^0fex„(X;S®*)$«(^'b,*) (5) 

where c* = (^"11(0, (1 + b'Sb)*))^^, </)(.) and $(.) denote the density function 
the cumulative distribution of the standard normal random variable correspond- 
ingly. A drawback of this definition is that it allows independence only over its 
rows or columns, but not both. Harrar ( [Harrar and Gupta(2008)] ) give two 
more matrix variate skew normal densities: 

/2(X,S,^',6,1]) =c;0fex„(X;S®*)$„(X'b,f^) (6) 

and 

/3(X, S, *, b, B) = c*^ct>uxn{X- S ® (7) 
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where C2 = ($n(0, {ft + b'Sb)*))"^ C3 = 2; S, vJ/, and are positive definite 
covariance matrices of dimensions k, n and n respectively, i? is a matrix of 
dimension k x n. Note that if 51 = ^ then /2 is the same as /i. Although, more 
general than /i , the densities /2 and fs s till do not permit independence of rows 
and columns simultaneously. In [Akdemir(2009)j , the following density is given 
to overcome this problem: 



fix, M, A, B, A) = \Am^2-^- 

(8) 

Here, the parameter M is a A: x n matrix. The scale parameters A and B are 
kx k and nxn positive definite matrices correspondingly. The shape parameter 
A is a matrix of order k x n. Finally, ej is the unit length k dimensional vector 
with 1 at its jth row and Ci is the unit length n dimensional vector with 1 at its 
ith row. We denote the distribution of a variable with density of the form ([8]) 
by msnkxn{M , A, B, A). Motivated by the model in ([9]) we first define a general 
class of selection models for the array variatc random variables. 

Definition 4.1. Let /(.) be a density for a array random variable of dimensions 
mi X 7712 X ... X mi and let g(.) be a weight function that takes an array of the 
same dimensions as its argument. A weighted form of density /(.) is given by 

fiX)g(X) 

h(X) = ■' ^ '^^ J ^ — ^. (9) 

When the sample is only a subset of the population then the associated model 
would be called a selection model. Here /(.) is called the kernel density and g{.) 
is called the weight or selection function. 

We will use the density for the array variate random variable in as the kernel 
density for the selection model. We obtain a class of skew normal array variate 
densities by using a selection function like the one in ([5]): 

Definition 4.2. A density for a skew normal array variate random variable 
is given by 



f{X;M,Ai,A2,...A,A) 
where 



cl){X; M, AuA2,... Ai)g{X; M, A^, A2, . . . A,, A) 

(10) 



11 

J n 



Ai, A2, . . . , Ai are non singular matrices of orders mi, m2, . . . , mi, M and A 
are constant arrays of the same dimension as X . 
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5 Discussion 



The models with Kronecker deha covariance structures provide a great deal of 
decrease in the number of parameters that has to be estimated. We will now 
discuss this in the context if principle component analysis. 

Principal components analysis is a useful statistical technique that has found 
applications in fields such as face recognition and image compression, and is a 
common technique for finding patterns in data of high dimension. The end 
product of PC A is a set of new uncorrelated variables ordered in terms of their 
variances obtained from a linear combination of the original variables. 

Definition 5.1. For the mi x m2 x . . . x TOj dimensional array variate random 
variable X, the principal components are defined as the principal components of 
the d = mim2 ■ ■ ■ mi- dimensional random vector rvec{X). 

The advantage in choosing a Kronecker structure is the decrease in the num- 
ber of parameters. If {\{Ar)rj} are the mj eigenvalues of ArA'^ with the cor- 
responding eigenvectors {{xr)rj } for r = 1, 2, . . . , i and rj = 1,2,..., mr, then 
[Ai®^ A2®'' Ai){Ai& A2& Ai)' wiU have eigenvalues {\{Ai)r^\{A2)r2 ■ ■ ■ A(^i)rJ 
with corresponding eigenvectors {{xij^^ & {x2)r2 & ■ ■ ■ & {xi)^}- By replacing 
Ar by their estimators, we can estimate the eigenvalues and eigenvectors of the 
covariance of rvec{X) using this relationship. 

When applying the array variate skew normal model to real data, more 
parsimonious forms of the model in Equation (jlOp should be considered. For 
example, a model where A is diagonal should be appropriate for most cases. 
One could further assume that many of these diagonal elements are zero. 
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